ON THE AUTOMORPHISM GROUP OF 
GENERALIZED BAUMSLAG-SOLITAR GROUPS 

Gilbert Levitt 

Abstract. A generalized Baumslag-Solitar group (GBS group) is a finitely gen- 
erated group G which acts on a tree with all edge and vertex stabilizers infinite 
cyclic. We show that Out(G) either contains non-abelian free groups or is virtually 
nilpotent of class < 2. It has torsion only at finitely many primes. 

One may decide algorithmically whether Out(G) is virtually nilpotent or not. If 
it is, one may decide whether it is virtually abelian, or finitely generated. The iso- 
morphism problem is solvable among GBS groups with Out(G) virtually nilpotent. 

If G is unimodular (virtually Fn x Z), then Out(G) is commensurable with a 
semi-direct product XI Out (if) with H virtually free. 
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1. Introduction and statement of results 

The groups BS{m,n) = {a,t \ ta'^t~^ = a") were introduced by Baumslag- 
Solitar [2] as very simple examples of non-Hopfian groups (a group G is non- 
Hopfian if there exists a non-injective epimorphism from G to itself). It is now 
known that BS{m^ n) is Hopfian if and only if m = ±1, or n = ±1, or m, n have 
the same set of prime divisors [6]. In particular, -85(2, 4) is Hopfian while BS{2, 3) 
is not. 

Though it has exotic epimorphisms, BS{2, 3) has very few automorphisms: 
its automorphism group is generated by inner automorphisms and the obvious 
involution sending a to [5, 13]. On the other hand, BS{2, 4) has an incredible 
number of automorphisms, as its automorphism group is not finitely generated [6]. 
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Typeset by 4a/(5-T^ 



The reason behind this drastic difference is that, because 2 divides 4 but not 3, 
the presentation of BS{2,4) is much more flexible than that of BS{2,3). By this 
we mean, in particular, that BS{2, 4) admits the infinite sequence of presentations 

S5(2, 4) = (a, 6, t \ tbt'^ = 6^, b^" = a^) (Ip) 

obtained from the standard one by introducing a new generator b = t~^o?t^. It is 
clear already from (Ip) that G = BS{2, 4) has many automorphisms, as fixing b, t 
and conjugating a by 6 defines an element of order 2^ in Out(G'). 

The presentations (Ip) express BS{2, 4) as a generalized Baumslag-Solitar group, 
or GBS group, or graph of Z's, namely as the fundamental group of a finite graph 
of groups r with all edge and vertex groups infinite cyclic. This is visualized as a 
labelled graph, with the absolute value of the labels indicating the index of edge 
groups in vertex groups (see Figure 1). 




Figure 1. The labelled graphs associated to the 
standard presentation of BS{m,n), and to (Ip). 

In this paper, we study automorphisms of GBS groups. See [11, 12, 18, 22, 31] 
for various algebraic and geometric properties of these groups. As pointed out in 
[11], they are especially interesting in connection with JSJ theory. 

Before giving general results, let us review certain classes of GBS groups for 
which more specific statements may be obtained. They are defined either by 
"local" conditions on the labelled graph, or by "global" algebraic conditions on 
the group. In the rest of this introduction, we always assume that G is not one of 
the elementary GBS groups: Z, Z^, and the Klein bottle group. 

Algebraically rigid groups. 

As evidenced by the example of BS{2,A), the main difficulty with GBS groups 
is that they may be represented by many different labelled graphs F. Sometimes, 
though, F is essentially unique. By [13, 28], this algebraic rigidity holds in par- 
ticular when there is no divisibility relation in F: if p, q are labels near the same 
vertex, then p does not divide q (see Section 2 for a precise definition and a char- 
acterization of algebraic rigidity). 

2 



Given F, let T be the associated Bass-Serre tree, which we call a GBS tree. 
Let Out^(G') C Out(G') be the sub group leaving T invariant. Most elements of 
Out^(G) may be viewed as "twists" (see Section 3). Algebraic rigidity implies 
Out^(G) = Out(G'), but in general Out^(G) is smaller. 

Theorem 1.1. Let G be a GBS group, represented by a labelled graph T, and let 
T be the Bass-Serre tree. Define k as the first Betti number b of F if G has a 
nontrivial center, as b — 1 if the center is trivial. 

(1) The torsion-free rank of the abelianization of G is k+1. 

(2) The group Out^(G') is virtually Z'^ . 

(3) Up to commensurability within Out(G), the subgroup Out-^(G) does not 
depend on T. 

Conversely, any subgroup of Out(G) commensurable with a subgroup of Out^(G) 
is contained in Out^ {G) for some GBS tree T' [4]. 

For G — BS{m,n), one has k — if m ^ n, and k = 1 if m = n. For 
G = BS{2,A) with the presentation (Ip), the group Out^(G) has order 2^+-^. 

Corollary 1.2. If G is algebraically rigid, then Out(G) is virtually Zi^. 

The converse is also true (see Theorem 8.5). 

Unimodular groups. 

A GBS group G is unimodular if xy^x~^ — with y ^ 1 implies \p\ — \q\, or 
equivalently if G is virtually x Z (with Fn a free group of rank n). The group 
G then has a normal infinite cyclic subgroup with virtually free quotient, and we 
show: 

Theorem 1.3. If G is unimodular, there is a split exact sequence 

|1| ^ z^^ ^ Outo(G) ^ Outo(i?) ^ {1}, 

where k is as above, H is virtually free, and Onto has finite index in Out. 

Since Oui{H) is VF [19], we get: 

Corollary 1.4. Out(G) is virtually torsion-free and VF (it has a finite index 
subgroup admitting a finite classifying space). 

Groups with no nontrivial integral modulus. 

Now consider groups G which do not contain a solvable Baumslag-Solitar group 
BS{1, n) with n > 2 (there is an equivalent characterization in terms of the mod- 
ular homomorphism A : G — > Q*, see Section 2). 

Given any GBS group G, the group Out(G) acts on the space PT> of all GBS 
trees (see Section 5), with stabilizers virtually by Theorem 1.1. Clay [3] proved 
that the space PV is contractible (see also [16]), and Forester [12] proved that the 
quotient is a finite complex if G does not contain BS{1, n) with n > 2. This gives: 
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Theorem 1.5. If G does not contain BS{1, n) for n > 2, then Out(G') is Foo (in 
particular, it is finitely presented). If furthermore Out (G) is virtually torsion-free, 
then it is VF. 

Arbitrary groups. 

Now let G be any GBS group. 

Theorem 1.6. Either Out(G') contains a nonabelian free group, or it is virtually 
nilpotent of class < 2. 

A group is nilpotent of class < 2 if and only if every commutator is central. As 
an example, let G = {a, s,t \ sa = as, ta^ = aH) (see Figure 2). Then Out(G) is 

(I ^ 3\ 

virtually the integral Heisenberg group ifa, with 10 1 k\ mapping (a, s, t) to 

(a, sa^, ts'a^). 




Figure 2. Out(G') is virtually the integral Heisenberg group ifs. 

Which possibility of Theorem 1.6 occurs may be explicitly decided from the 
divisibility relations in any labelled graph F representing G. We have seen that 
Out(G) is virtually abelian if there is none. A key observation is that certain 
divisibility relations force the existence of F2 inside Out(G'). 



5 4 2 3 

• • • 

a b c 



Figure 3. Out(G') contains F2. 

As a basic example, consider G = (a, 6, c | = 6*, 1? = (?) (see Figure 3). It is 
the amalgam of G\ = (a) with G2 = {b, c) over C = (6^). The divisibility relation 
2|4 at the middle vertex implies that C is central in G2- For any (7 G G2, we 
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may therefore define an automorphism ipg of G as being the identity on Gi and 
conjugation by g on G2- It is easy to show that the subgroup of Out(G') generated 
by the (pg's is isomorphic to (6, c | 6^ = = 1), hence contains F2. 

To prove Theorem 1.6, we assume that Out(G) does not contain F2 and we 
describe which divisibility relations may occur (Section 6). In Section 7, we show 
that, though the GBS tree T may not be Out(G)-invariant, some (non GBS) tree 
S obtained from T by collapsing certain edges is. We then prove that Out'^(G') is 
virtually nilpotent. 




n 



2 

{ ) 

Figure 4. Out(G) is virtually an infinitely gen- 
erated abelian group if n is not a power of 2. 

For instance, let G = {a,b,t \ tbt~^ = 6^, b"^ = a?) with n not a power of 2 (see 
Figure 4). In this case, S is obtained from T by collapsing edges projecting onto 
the loop of F. The group Out(G') is virtually abelian (but not finitely generated). 

A special case of Theorem 1.6 is: 

Theorem 1.7. If no label ofV equals 1, then Out(G) contains F2 or is a finitely 
generated virtually abelian group. 

As a corollary of our analysis, we show: 

Theorem 1.8. The isomorphism problem is solvable for GBS groups G such that 
Out(G') does not contain F2. 

The isomorphism problem for GBS groups is to decide whether two labelled 
graphs define isomorphic groups. It is solvable for groups with no nontrivial inte- 
gral modulus [12] and 2-generated groups [22], but open in general. 

We also show: 

Theorem 1.9. The set of prime numbers p such that Out(G') contains non-trivial 
p-torsion is finite. 

The paper is organized as follows. In Section 2, we review basic properties of 
GBS groups, such as algebraic rigidity and the modular homomorphism A. We 
extend to GBS groups a result of [9] about twisted conjugacy classes. In Section 
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3, we study Out-^((j), proving Theorems 1.1 and 1.9. Section 4 is devoted to 
unimodular groups, Section 5 to the action of Out(G) on PV. Theorem 1.6 is 
proved in Sections 6 and 7. In Section 8 we discuss several special cases and the 
isomorphism problem. 

Acknowledgments. / am grateful to M. Forester and M. Clay for helpful suggestions, and to 
P. Papasoglu for pointing out that Out(BS'(2, 4)) is not finitely generated. 

2. Basic facts about GBS groups 

Labelled graphs. 

A GBS group G is the fundamental group of a finite graph of groups T whose 
vertex and edge groups are all infinite cyclic. It is torsion-free. 

We denote by b the first Betti number of the graph F. Note the distinction 
between G = 7ri(r) and the topological fundamental group 7r^°^(r) ~ Fi,. 

If we choose generators for edge and vertex groups, the inclusion maps are 
multiplications by non-zero integers. An oriented edge e thus has a label Ae G 
Z \ {0}, describing the inclusion of the edge group Ge into the vertex group Go(e) 
at the origin of e. As in [12], we visualize the graph of groups as a labelled graph 
r, with the label Ag pictured near the origin o(e). 

A pair e = (e, e) of opposite edges is a non-oriented edge. It carries two labels, 
one near either endpoint o(e), o(e), and we say that e (or e) is a (Ae, Xe)-edge. An 
edge is a loop if its endpoints are equal, a segment if they are distinct. 

The group G associated to a labelled graph T may be presented as follows. 
Choose a maximal subtree Fq C F. There is one generator Xy for each vertex v, 
and one generator tg for each non-oriented edge e not in Fq. Each non-oriented 
edge e = (e, e) of F contributes one relation. If e is contained in Fq, the relation 
is (a;o(e))^*-'^'' = {xo{e))'^^^^ ■ If ^ is not in Fq, the relation is tci{xo{e))'^^'^^'te^ = 

Replacing the chosen generator of a vertex group Gy by its inverse changes 
the sign of all labels near v. Replacing an edge group generator changes the sign 
of both labels carried by the edge. These changes are admissible sign changes. 
Labelled graphs will always be considered up to admissible sign changes. 

When we focus on a particular edge, we always use admissible sign changes to 
make it a {p, g)-segment with p, g > 0, or a {p, g)-loop with 1 < p < |g|. 

A (l,g)-loop is an ascending loop. It is a strict ascending loop if |g| > 1; note 
that G then contains a solvable Baumslag-Solitar group BS{l,q). A (p, g)-loop 
with p|g is a pseudo- ascending loop. 

GBS trees. 

Let G be the fundamental group of a labelled graph F. The associated Bass- 
Serre tree is a locally finite G-tree T with all edge and vertex stabilizers infinite 
cyclic. Such G-trees will be called GBS trees. Two trees are considered to be the 
same if there is a G-equivariant isomorphism between them. 

We always assume that the action is minimal: there is no proper invariant sub- 
tree. In terms of F, this is equivalent to saying that the label near every terminal 
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vertex is bigger than 1. We also assume that actions are without inversions. 

Given a GBS tree T, one obtains a labeUed graph F = T /G, with the labeUing 
weU-defined up to admissible sign changes (see Remark 2.3 in [12]). This graph 
of groups is marked: there is an isomorphism from its fundamental group to G, 
well-defined up to composition with an inner automorphism. The valence of a 
vertex f G T is the sum of the absolute values of the labels near its image in F. 

GBS trees T and marked labelled graphs F are thus equivalent concepts. We 
will work with both. We usually use the same letter v (resp. e) for a vertex (resp. 
edge) of T and its image in F. When we need to distinguish, we write v for 
the image of v in F. We denote vertex stabilizers (vertex groups) by G^, edge 
stabilizers (edge groups) by Gg. 

Collapses and algebraic rigidity. 

Collapsing an edge e of F (or equivalently a G-orbit of edges of T) yields a new 
tree S, which usually is not a GBS tree. It is a GBS tree if and only if e is a 
segment and at least one of the labels Ae, Ag equals 1. Such an edge will be called 
a collapsible edge. 

In the proof of Theorem 1.6, we will collapse (2, 2)-edges and (1, g)-loops; these 
are not collapsible edges. We usually denote by O the collapsed graph of groups, 
by TT : T — > the collapse map. The image of a vertex f G T is denoted by 7r(t;), 
or sometimes just v. The stabilizer of ti{v) in S contains the cyclic group G^, we 
call it (it will often be a solvable Baumslag-Solitar group). We use the same 
letter for a non-collapsed edge of T and its image in S. It has the same stabilizer 
in both trees. 

Collapsing a collapsible edge is called an elementary collapse. The reverse move 
is an elementary expansion. Labels near o(e) get multiplied by Ae when we collapse 
an edge e with Ag = 1 (see Figure 5). 




Figure 5. Elementary collapse. 

The graph F, or the tree T, is reduced (in the sense of [10]) if there is no 
collapsible edge. In terms of trees, T is reduced if and only if any edge e = vw 
satisfying Ge = G„ has its endpoints in the same G-orbit. Any tree may be reduced 
by applying a finite sequence of elementary collapses (the reduction is not always 
unique) . 

A reduced GBS tree T is rigid if it is the only reduced GBS tree (up to equi- 
variant isomorphism). Building on work from [10, 13, 14, 28], it is shown in [21] 
that, if G is not solvable, T is rigid if and only if F satisfies the following condition 
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Figure 6. A labelled graph representing an algebraically rigid group. 

(see Figure 6): if e, / are distinct oriented edges of F with the same origin v, and 
the label of / near v divides that of e, then either e = / is a (p, ±p)-loop with 
p > 2, or V has valence 3 and bounds a (1, ±l)-loop. 

In particular, T is rigid whenever there is no divisibility relation in F (recall 
that a divisibility relation is a relation p\q between two labels at the same vertex). 

When there is a rigid GBS tree, we say that G is algebraically rigid. In this 
case, there is only one reduced marked labelled graph representing G. See [26, 31] 
for quasi-isometric rigidity of GBS groups. 

Non-elementary groups. 

We say that G is elementary if T may be chosen to be a point or a line. As 
vertices of T then have valence at most 2, there are only four possibilities for F: 
a point, a (1, l)-loop, a (1, — l)-loop, a (2, 2) -segment. The corresponding groups 
are Z, Z^, and the Klein bottle group (x,t | txt~^ = x~^) = (a, 6 | = 6^), with 
Out(G') equal to Z/2Z, GL{2, Z), and Z/2Z x Z/2Z respectively. 

Though non-elementary, the solvable groups BS{l,n) are special. For \n\ > 1, 
the group Out(i?S'(l, n)) is virtually Z''"^, where r is the number of prime divisors 
of n [5]. More generally, see [5, 6, 13] for a presentation of Out(i?5'(m, n)). 

From now on, we consider only non-elementary groups. Here are a few simple 
properties (compare [11]). 

From the action of G on T, it is easy to see that a non-elementary GBS group 
either is a solvable Baumslag-Solitar group BS{l,n) (if it fixes an end of T), or 
contains non-abelian free groups (if the action on T is irreducible). In particular, 
G always has exponential growth. A finitely generated subgroup of G is free (if it 
acts freely on T) or is a GBS group. A non-elementary GBS group is one-ended, 
coherent, and has cohomological dimension 2 [11, 18]. 

Any GBS group maps onto Z (the presentation of G given earlier has more gen- 
erators than relators). GBS groups are therefore locally indicable, hence orderable 
(see [30]). Using the fact that (a, b \ = b'^) is bi-orderable only if \p\ or \q\ equals 
1, one shows that the only bi-orderable GBS groups are x Z and BS{1, n) for 
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n > 1. 



Elliptic elements. 

Two subgroups H^K of G are commensurable if H (iK has finite index in both 
H and K. Two elements g, h are commensurable if (g) and (h) are commensu- 
rable, equivalently if there is a relation g^ = h'^ with q non-zero integers. The 
commensurator of g is the subgroup Comm{g) consisting of all a; e G such that 
xgx~^ is commensurable to g. 

Given any G-tree T, an element (7 G G, or a subgroup if, is elliptic if it fixes 
a point. If g is not elliptic, it is hyperbolic: there is an invariant axis, on which g 
acts as a translation by some positive integer i{g). Conjugate or commensurable 
elements have the same type (elliptic or hyperbolic). A relation gaPg~^ = 
with \p\ ^ \q\ implies that a is elliptic, because its translation length satisfies 
\p\e{a) = \q\e{a). 

Lemma 2.1 [10]. Let T be a GBS tree, with G non- elementary. Any two non- 
trivial elliptic elements g, g' are commensurable. An element g & G is elliptic if 
and only if its commensurator equals G. 

Proof. If g,g' fix vertices v,v', one shows that they are commensurable by induc- 
tion on the distance between v and v' . If g is hyperbolic, its axis is Comm{g)- 
invariant, so Comm{g) ^ G because G is not elementary. □ 

Corollary 2.2. The set of elliptic elements depends only on G, not on the GBS 
tree T. It is invariant under automorphisms of G. U 

As any two GBS trees have the same elliptic subgroups. Forester's deformation 
theorem [10] yields: 

Corollary 2.3. Let G he a non- elementary GBS group. Any two GBS trees are 
related (among GBS trees) by a finite sequence of elementary expansions and col- 
lapses. □ 

The quotient G/Geii of G by the subgroup generated by all elliptic elements 
may be identified with the (topological) fundamental group 7r{°^(r) of the graph 
r (this is a general property of graphs of groups). All labelled graphs representing 
G thus have the same first Betti number, denoted by b. 

All homomorphisms from G to a free group with non-abelian image factor 
through the quotient map 9 : G G/G^u — (because in a free group the 
commensurator of any non-trivial element is cyclic). Since G always maps onto Z, 
the maximum rank of a free quotient of G is max(6, 1). 

The modular homomorphism A. 

Let G be a non-elementary GBS group. The set £ consisting of all non-trivial 
elliptic elements is stable under conjugation, elements of £ have infinite order, and 
any two elements of £ are commensurable. These properties yield a homomorphism 
A from G to the multiplicative group of non-zero rationals Q*, defined as follows. 

Given gf G G, choose any a E £. There is a relation ga^g~^ = a'^, with p,q 
non-zero, and we define A{g) — -. As pointed out in [17], it is easily checked 
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that this is independent of the choices made (a and the relation), and defines a 
homomorphism. We call A{g) the modulus of g. Note that A o cu = A if cu is any 
automorphism of G, because S is ct-invariant. 

Let H he a finite index subgroup of G. Any GBS G-tree is also a GBS H-tree, 
so iif is a GBS group. The modular homomorphism of H is the restriction of that 
of G. 

Every elliptic element has modulus 1, so A factors through the free group 
G/Geii ~ Ffe. In particular, A is trivial when F is a tree. If F is a labelled graph 
representing G, one has G/G^u — 7r{^°^(F) and the modulus may be computed as 
follows (see [1, 12]): if 7 e 7ri°^(r) is represented by an edge- loop (ei, . . . , e^), its 

m ^ 

modulus is simply JJ^ — ^. 

We denote by M the image of A. It is a subgroup of (Q*, x). If G = BS{m, n), 
then M is generated by ^. If G is represented by the labelled graph of Figure 6, 
then M is generated by —1 and — |. 

Lemma 2.4. Let r = ^ be a nonzero rational number, written in lowest terms. 
Assume r 7^ ±1. 

(1) r G M if and only if the equation xyPx~^ = y'^ has a solution with y ^ I. 

(2) // r G Z, then r E M if and only if G contains a subgroup isomorphic to 
BS{l,r). 

Proof. If ^ G M, the equation xy'^Px~^ = y"''^ has a non-trivial solution for some 

n G Z, so xyPx~^ — y'^ has a non-trivial solution. Conversely, if \p\ ^ \q\ and 
xyPx~^ = y^ has a non-trivial solution, then y must be elliptic and therefore 
I = A(a;) G M. We have proved (1). 

If xy^x~^ = y with y ^ 1 and r an integer different from —1,0, 1, then H = 
{x, y) is a solvable GBS group, and A(x) = r, so if ^ BS{1. r) (one may also show 
H ~ BS{1, r) by arguing that the only torsion-free proper quotient of BS{1., r) is 

Z). n 

Remarks. • The values ±1 are special. If G is represented by a labelled tree F 
containing a (2,2)-edge, then xyx~^ — y~^ has a nontrivial solution because G 
contains a Klein bottle group, but — 1 ^ M because F is a tree. Conversely, 1 
always belong to M, but BS{1, n) does not contain 7? = BS{1, 1) for |n| > 1. 

• It is probably not true that G always contains BS{p, g) if ^ ^ ±1 is a modulus. 

• Using A, it is easy to show that the isomorphism type of BS{m, n) determines 
m and n (normalized by 1 < m < |?i|) [25]. In most cases, m and n are determined 
by m/n (given by A) and |m — n| (given by abelianizing) . To obtain m from 
BS{m, m), observe that the quotient of BS{m, m) by its center is Z * 7i/mTi. 

We say that G has trivial modulus if M = {1} (we often write this as A = 1). 
It is unimodular if M C {1,-1}, equivalently if xy'^x~^ = with y ^ I implies 
p = ±q. As in [12], we say that G has no nontrivial integral modulus if M fl Z C 
{1,-1}. This is equivalent to saying that G contains no solvable Baumslag-Solitar 
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group BS{l,n) with n > 2 (we may take n > because BS{l,—n) contains 
BS{l,n')). 

Unimodular groups. 

Proposition 2.5. Let G be a non- elementary GBS group. The center Z{G) of G 
is infinite cyclic if G has trivial modulus, trivial otherwise. It acts as the identity 
on any GBS tree. 

Proof. Let T be any GBS tree (recall that T is always assumed to be minimal). 
If a is central (more generally, if (a) is normal), it is elliptic, as otherwise its axis 
would be a G-invariant line. The fixed point set of a is a G-invariant subtree, so 
equals T by minimality. This shows that Z[G) is contained in the kernel of the 
action (elements acting on T as the identity). In particular, it is trivial or cyclic. 

If A(gf) 7^ 1 and a & S, there is a relation gaPg~^ = with p q, so a cannot 
be central. This shows that Z{G) is trivial if G does not have trivial modulus. If 
A is trivial, choose any finite generating system Si for G, and a E S. For each i, 
there is a relation Sia'^^s~^ — oP'^ with ^ 0. It follows that some power of a is 
central. □ 

Proposition 2.6. Let G he a non- elementary GBS group. The following are 
equivalent: 

(1) G is unimodular. 

(2) G contains a normal infinite cyclic subgroup Z . 

(3) G has a finite index subgroup isomorphic to x Z for some n > 1. 
The quotient of G by any normal infinite cyclic subgroup Z is virtually free. 

Proof. Suppose G is unimodular. The kernel of A has index 1 or 2, and has trivial 
modulus. Its center is infinite cyclic and characteristic in G, so (1) implies (2). 

Suppose Z is infinite cyclic and normal. Let T be any GBS tree. As in the 
proof of Proposition 2.5, one shows that Z is contained in the kernel of the action. 
The quotient G/Z acts on T with finite stabilizers, so is virtually free. This easily 
implies that G is virtually x Z. 

If G is virtually F^ x Z, its modulus is trivial on a finite index subgroup, so M 
is finite, hence contained in {1, —1}. □ 

Remarks. • Let T be a GBS tree. If G is unimodular, we have seen that 
Z(ker(A)) is contained in the kernel of the action on T. Conversely, if the ac- 
tion has a nontrivial kernel K, then G is unimodular (because K is normal and 
cyclic), and furthermore K = Z(ker(A)). To see this, simply note that, if a 
generates one has ga,g"^ = a^^ for any g E G, so a commutes with ker(A). 

• Two non-solvable GBS groups are quasi-isometric if and only if they are both 
unimodular or both non-unimodular [31]. Any torsion- free group quasi-isometric 
to F„ X Z with n > 1 is a unimodular GBS group [26]. 

• A GBS group is residually finite if and only if it is solvable or unimodular 
[22]. 
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Twisted conjugacy classes. 

Let a : G — s> G be an endomorphism. Two elements g,g' E G are a-conjugate if 
there exists h such that g' — hga{h)~^. The number of a-conjugacy classes is the 
Reidemeister number of a, denoted by R{a). It is relevant for fixed point theory 
(see [9]). 

Proposition 2.7. Let a : G ^ G be an endomorphism of a non- elementary GBS 
group. If one of the following conditions holds, then R{a) is infinite: 

(1) a is surjective. 

(2) a is injective and G is not unimodular. 

(3) G = BS{m,n) with \m\ ^ \n\, and the image of a is not cyclic. 

This generalizes results of [9] about Baumslag-Solitar groups. 

Proof. First suppose that G is unimodular and a is surjective. The group G 
is residually finite (because it is virtually x Z), hence Hopfian. We therefore 
assume that a is an automorphism. The subgroup Z — Z(ker(A)) is characteristic, 
so a induces an automorphism /? on the virtually free group G/Z. As G/Z is a 
non-elementary (word) hyperbolic group, R{P) is infinite [23, 8]. This implies that 
R{a) is infinite. 

From now on, we assume that G is not unimodular. If a is an automorphism, 
we know that A o a = A, so a-conjugate elements of G have the same modulus. 
As M is infinite, we get R{a) infinite. This argument works in the general case, 
but we have to prove A o q; = A for endomorphisms satisfying (1), (2), or (3). 

We first claim that a does not factor through 9 : G G/G^u — F^- This is 
clear if (2) or (3) holds. If a surjective a factors as po^, then 6* op is a non-injective 
epimorphism from F(, to itself, a contradiction because free groups are Hopfian. 

We can now show A o a = A. Since a does not factor through 0, there is an 
elliptic a with a{a) ^ 1. As G is not unimodular, there is a relation goa^g^^ = a"" 
with \m\ 7^ |n|. From a{gQ)a{a)'^ a{gQ)~^ = a;(a)"', we deduce that a(a) is elliptic. 
Thus a{a) is a nontrivial elliptic element, and may be used to compute A. Given 
any gr, we have a relation gaPg~^ — a'^. We then write a{g)a{aY a{g)~^ — Q;(a)'^, 
showing that g and a{g) have the same modulus |. □ 

3. The automorphism group of a GBS tree 

General facts. 

Let G be any finitely generated group. As above, we consider G-trees up to 
equivariant isomorphism. There is a natural action of Out(G) on the set of G- 
trees, given by precomposing an action of G on T with an automorphism of G 
(composing with an inner automorphism does not change the tree). 

Given T, we denote by Out^(G) C Out(G) its stabilizer: $ is in Out^(G) if 
and only if T, with the action of G twisted by $, is equivariantly isomorphic to T 
with the original action. When T is irreducible, this is equivalent to saying that 
the length function £ satisfies £ o $ = 

12 



We recall results of [20] about Out^(G'). We assume that T is minimal and is not 
a line (but there is no condition on edge and vertex stabilizers in this subsection). 
The quotient graph of groups is denoted by F, its vertex set by V . 

There is a natural homomorphism from Out^(G) to the symmetry group of F 
(viewed as a graph with no additional structure) . The kernel is a finite index sub- 
group Outo (G), and there is a homomorphism p : Outg (G) — > HweV' C)ut(G„). All 
automorphisms of Gy which occur in the image of p preserve the set of conjugacy 
classes of incident edge groups. 

The kernel of p is generated by the group of twists T(T) together with automor- 
phisms called bitwists (bitwists belong to T(T) when vertex groups are abelian). 
The group T{T), which we also denote by T(F), will play an important role in the 
sequel. Before defining it, we mention that, when edge groups are cyclic, there is a 
further finite index subgroup Outf (G) C OutJ(G) with Outf (G) n ker p = T(r). 
It will be used in Section 7. 

To define T(T), we first consider an oriented edge e of F, with origin o(e) = v. 
Let Gg, Gy be the corresponding edge and vertex groups, with Gg identified to its 
image in Gy. We denote by Z^^. (Ge) the centralizer of Ge in G„. 

Given z G ZG^{Ge), we define the twist D{z) e Out(G) by z around e as 
follows (see [20] for details). If e is separating, it expresses G as an amalgam 
G = Gi G2. Then D{z) is defined as the identity on Gi, and conjugation by z 
on G2. If e does not separate, G is an HNN-extension and D{z) maps the stable 
letter t to zt (keeping the base group fixed). 

The group of twists T{T), or T(F), is the subgroup of Out(G) generated 
by all twists. As twists around distinct edges commute, T(F) is a quotient of 
Y[ ZQ^^^^{Ge), the product being taken over all oriented edges of F. Proposition 
3.1 of [20] says that only two types of relations are needed to obtain a presentation 
of T(r). 

For each pair of opposite edges (e,e), there are edge relations associated to 
elements z in the center Z^G^) (twisting by z near the origin of e defines the same 
outer automorphism as twisting by z~^ near the origin of e). For each vertex 
V, there are vertex relations associated to elements z e Z(Gy) (twisting by z 
simultaneously around all edges with origin v defines an inner automorphism). 

Remark 3.1. Let e C F be a segment such that both adjacent vertex groups are 
abelian. Using the vertex relations, one sees that T(r) is generated by the groups 
ZGo(f) (G*/) with / 7^ e, e. Collapsing e yields a new graph of groups whose group 
of twists contains T(r). 

Our main tool for finding free groups F2 in Out(G) will be: 

Lemma 3.2. Let T be a minimal graph of groups, with fundamental group G. 
Let e he an edge with origin v, and let Ge, Gy be the corresponding groups. The 
subgroup T(r) C Out(G) maps onto ZQ^{Ge)/ {Z{Gy)j Z{Ge)) ■ 

We denote by {Z {G y) , Z {G g)) the (obviously normal) subgroup generated by 
the centers of Gy and Ge- 
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Proof. Divide T{T) by (the image of) all factors Zo^^j-^iGf) for / 7^ e (including 
/ = e). The only relations which remain are those involving Zq^ [Ge), namely edge 
relations associated to (e,e) and vertex relations associated to v. The quotient is 
precisely ZgAG,) / {Z{G^), Z{G,)). □ 

The group of twists of a GBS tree. 

Now let G be a non-elementary GBS group. We consider the action of Out(G) 
on the set of GBS trees. The corresponding action on the set of marked graphs is 
by changing the marking. If T is rigid, then Out"^(G) = Out(G). 

The group of twists T(T) is a finitely generated abelian group. The presentation 
recalled above may be rephrased as follows (we use additive notation). 

Given an oriented edge e of F, there is one generator D^. If e is separating, Dg 
is the identity on Gi, and conjugation by Xy on G2 (with Xy the generator of the 
vertex group at v = o(e), and G = Gi *Ge G2 as above). If e does not separate, 
choose a maximal tree Fq not containing e. In the corresponding presentation of 
G, define as mapping te to Xo(e)te and keeping all other generators fixed. 

In terms of these generators Dg, the relations are the following. For each pair 
of opposite edges (e, e), there is an edge relation Ae-De + ^eDe — 0, implied by the 
relation {xo(e))'^^'^^ = {Xo{e))^^'^^ or te{Xo(e))'^^'^^t~^ = {xo(e))'^^^^ ■ For each vertex 
V, there is a vertex relation ^g^^;^ -De = 0, with the set of edges with origin v. 

Remark. The group G is in a natural way the fundamental group of a 2-complex 
consisting of annuli (corresponding to edges of F) glued to circles (corresponding 
to vertices). One can consider the subgroup DT(r) of T(F) generated by Dehn 
twists supported in the annuli. It is easy to see that it has finite index. One may 
also show T(r) = DT{T'), where F' is a (non reduced) graph obtained from F by 
elementary expansions. 

Recall that b is the first Betti number of any labelled graph F representing G. 

Proposition 3.3. Let G be a non- elementary GBS group. Define k as b if G has 
trivial modulus, b — 1 if not. 

(1) The torsion-free rank of the abelianization Gab is k + 1. 

(2) Let F be any labelled graph representing G. The torsion-free rank of the 
abelian group T(F) is k. 

(3) If Tq (Z T is a maximal subtree, the twists Dg around the edges 0/ F \ Fq 
generate a finite index subgroup ofTiV). 

Proof. Killing all elliptic elements produces an epimorphism d : G ^ (see 
Section 2), so rk(Gab) > b. If A is nontrivial, any elliptic element a satisfies a 
relation gaPg~^ = a'^ with p 7^ g, so is mapped trivially to torsion- free abelian 
groups. This shows rk{Gab) = b in this case. 

If A is trivial, fix F and Fq. It follows from the presentation of G given earlier 
that Gab is the direct sum of Z** with the abelian group G' defined by the following 
presentation: there is one generator Xy for each vertex of F, and one relation 
^eXo(e) = AeXo(e) for cach pair of opposite edges (e, e). We show that G' maps non- 
trivially to Z. It is easy to map the generators Xy to Z in such a way that relations 
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associated to edges in Fq are satisfied. Using the formula A (7) = H^i (^^^ 

"3 

Section 2), one sees that the remaining relations are automatically satisfied. We 
get rk{Gab) = h + l. 

Assertion (2) follows immediately from Proposition 2.5 and the exact sequence 

^ z{G) ^ z^+^ ^ z^^ ^ r ^ 

given by Proposition 3.1 of [21], where v (resp. C) is the number of vertices (resp. 
edges) of V (we are grateful to M. Clay for suggesting this short argument). 

Assertion (3) follows from the presentation of T(T) in terms of the generators 
De- If we add the relations D^. = Dg = for e ^ Fq, the quotient is the group of 
twists associated to the labelled graph Fq, so is finite by Assertion (2). □ 

Remark 3.4. One may decide whether a given Dg has finite or infinite order. If e 
does not separate, the order of is finite if and only if G has nontrivial modulus, 
but every loop not containing e has trivial modulus. If e separates, the order is 
infinite if and only if each component of F \ {e} contains a loop with nontrivial 
modulus. 

The groups T{T) associated to different GBS trees are abstractly commensu- 
rable by Proposition 3.3. We show that they are commensurable as subgroups of 
Out(G'). 

Proposition 3.5. IfT,T' are two GBS trees, thenT{T) andT{T') are commen- 
surable subgroups o/Out(G). 

Proof. By Corollary 2.3, it suffices to show that T{T') is commensurable with T{T) 
if T' is obtained from T by an elementary collapse. Consider the corresponding 
graphs F, F'. Let e = vw <ZT he the collapsed edge. We assume Ae = 1, and we 
denote Ag by A, so Gy has index A in G^. 

Let F be the set of oriented edges of F other than e,e. The group T(T) is 
the subgroup of Out(G) generated by the twists -D/, / G F (see Remark 3.1). 
Similarly, T(T') = {D'^ \ f e F), as F may be viewed as the set of oriented edges 
of F'. Moreover, we have -D/ = -Dj if the origin of / is not v, and Df = XD'^ if it 
is because the collapse replaces the vertex group Gy of F by the larger group G^j ■ 
This shows that T{T') contains T{T) as a subgroup of finite index. □ 

Remark 3.6. The index of T(T) in T{T') divides a power of the label A. This 
will be used in the proof of Theorem 3.12. 

Applications. 

We apply the preceding results to the study of Out^(G), using the following 
fact: 

Proposition 3.7 [20]. T{T) has finite index in Out'^(G). 

This follows from Theorem 1.6 of [20], as edge and vertex groups have finite 
outer automorphism groups. More precisely, let us show: 
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Proposition 3.8. Given G, the index ofT{T) in Out-^(G) is uniformly bounded 
(independently ofT). 

Proof. Consider the chain of subgroups T(T) C kerp C Out(^(G) C Out"^(G') 
mentioned at the beginning of this section. We check that each group has uniformly 
bounded index in the next. 

The index of OutQ^(G) in Out^(G) is bounded by the order of the symmetry 
group of r. The number of edges of T is not always uniformly bounded, but the 
first Betti number is fixed, and there is a uniform bound for the number d of 
terminal vertices (because adding the relations Xy = 1, for v non-terminal, maps 
G onto the free product of d nontrivial finite cyclic groups). This is enough to 
bound the symmetry group. 

The map p describes how automorphisms act on vertex groups. Since these 
groups are all commensurable, and isomorphic to Z, the image of p has order at 
most 2, so ker p has index at most 2 in Outo'(G)- Finally, ker p is generated by 
T(T) together with bitwists. As vertex groups are abelian, bitwists belong to 
r(T), so r(T) = kerp. □ 

If T is rigid, then Out^(G) = Out(G). We get: 

Theorem 3.9. If G is algebraically rigid, then Out(G) contains TJ^ as a subgroup 
of finite index. □ 

In general, we have: 

Theorem 3.10. Up to commensurability, the subgroup Out^(G) o/Out(G) does 
not depend on T. It contains with finite index. □ 

Another proof of the first assertion (and therefore of Proposition 3.5, but not 
of Remark 3.6) is given in Section 5. Also note the following related result: 

Theorem 3.11 [4]. Any subgroup o/Out(G) commensurable with a subgroup of 
Out-^(G) is contained in OmI^ (G) for some GBS tree T' . □ 

We now prove: 

Theorem 3.12. The set of prime numbers p such that Out(G) contains non- 
trivial p-torsion is finite. 

Proof. As any torsion element of Out(G) is contained in some Out^(G) by [4], 
and the index of T(T) in Out^(G) is uniformly bounded by Proposition 3.8, it 
suffices to control torsion in groups of twists. 

First note that the set of prime numbers dividing a label of F does not depend 
on F, as it does not change during an elementary collapse. Call it V. If T and 
T' are related by an elementary collapse. Remark 3.6 shows that T(T) and T{T') 
have torsion at the same primes, except possibly those in V. This implies that 
only finitely many primes may appear in the torsion of a group of twists: those in 
V, and those in the torsion of T{Tq) for some fixed Tq. □ 

We have seen that Out(i?5'(2, 4)) contains arbitrarily large 2-torsion. The proof 
of Theorem 3.12 also shows: 
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Corollary 3.13. If p is a prime number such that Out(G') contains p-torsion 
of arbitrarily large order, then p divides at least one label of each labelled graph 
representing G. U 



We do not know whether p must divide some integral modulus. 

4. Unimodular groups 

Let r be a labelled graph representing a non-elementary unimodular group G, 
and T the associated Bass-Serre tree. We denote by the kernel of A : G — > 
{±1} [positive elements). All elliptic elements are positive. Let Z be the center of 
G^ . We know that it is cyclic, characteristic in G, and acts as the identity on T. 

We fix a nontrivial 5 & Z. If A = 1 wc may take 5 to be a generator but the 
study of Out(G) when A 7^ 1 will require 5 to be (5o)^- Note that any generator 
of an edge or vertex group is a root of 5. 

Let Z' be the cyclic group generated by 5. There is an exact sequence {1} — > 
Z'— >G— >{1} with H virtually free. The group H is the fundamental group 
of a graph of groups with the same underlying graph. Vertex and edge groups are 
finite cyclic groups, the order being the index of {5) in the original group. We 
denote by g the image of 51 G G in i7. 

Since Z' is characteristic in G, there are natural homomorphisms Aut(G) 
Aut(iy) and Out(G) — > Out(iy). The basic example is Out(F^ x Z), which contains 
the semi-direct product Z"^ x Out(F^) with index 2 (the factor Z" should be 
thought of as Hom(F^,Z)). But the following examples illustrate a few of the 
subtleties involved when trying to lift automorphisms from H to G. 

Examples. 

• Let G be (a, b \ — b^) and H be (a, b \ d'^ — b^ = 1). The automorphism of 
H mapping a to and btob does not lift to G. 

• G is BS{S,S) = (a,t I taH'^ = a^) and H is (a,f \ = 1). The auto- 
morphism fixing a and sending t to ta has order 3, but all its lifts have infinite 
order. 

• G is BS{2, —2) — {a,t \ ta^t~^ — a~^) and H is (a, f | a? — 1). Conjugation 
by a in i7 has lifts of order 2, such as a 1— > a, 1 1— > ata, or a 1— > a~^,t h- > ata~^, but 
no lift of order 2 is inner. 

Let be the image of G~^ in H. If A 1, it has index 2 (because d is 
positive). There are only finitely many conjugacy classes of torsion elements in H 
(they all come from vertex groups). All torsion elements of H belong to H'^, but 
a conjugacy class in H may split into two classes in . 

We shall now define a homomorphism r : G ^ Isom(R) (it is similar to the 
homomorphism G' — > Z constructed in the proof of Proposition 3.3). We fix a 
maximal tree Fq C F. Recall the presentation of G with generators Xy^te and 
relations of the form = or tex'^t~^ = x^. 

To define r, send 5 to x 1— > x ^- 1, send x^ to x ^ x -\- l/n„ if 5 = x"", send t^ 
to a; I— > /^(ts)x^ and check that the relations are satisfied. This r is not canonical 
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(it depends on the choice of Fq); it is uniquely defined on eUiptic elements once S 
has been chosen. 

The image of r in Isom(R) is infinite cyclic if A = 1, infinite dihedral if A 1. 
Its kernel contains no nontrivial elliptic element. The coefficient of x in T{g) is 
A(^), and r{gcg~^) = t(c)^(^) if c is positive (in particular if c is elliptic). 

The map r induces a map r from H to a. finite group F (the quotient of the 
image of r by a; i— > a; + 1). The group F is cyclic if A = 1, dihedral if A 1. 

Definition. We define the finite index subgroup Auto{H) C Aut(iy) as the set 
of automorphisms a such that: 

(1) a{H+) = H+; 

(2) a acts trivially on the set of i^^-conjugacy classes of torsion elements; 

(3) T oa — T. 

Lemma 4.1. Let a e AvLto{H). There exists a unique lift a e Aut(G) such that 
T o a = T. It satisfies a{S) = S. 

Proof. Uniqueness is easy: a{g) is determined up to a power of S, and that power 
is determined by applying r. 

We define a on the generators of G. In H, the element Xy has finite order 
and therefore is mapped by a to gyXyg~^ for some gy G . We define a{xy) = 
gvXyg~^, where gy e is any lift of gy. Note that T{a{xy)) = T{xy) because Xy 
and gy are positive. If x^ = is a relation, then a{xy)'^a{xyj)~'^ is 1 because it 
is killed both in H and by r. Note that a{6) = a{Xy'') = gyXy^gy^ = 6. 

Now consider a generator te, and a lift ttg of a(tg). Since Toa = t, the elements 
tg and Ug have the same image in F, so T{tgU~^) is translation by an integer n^. 
We define ^(tg) as d^^Ug, so that T{a{tg)) — T{ts). Given a relation tgX^tg^ — x^, 
the relation a{te)a{xy)^a{te)~^ = a{xw)'^ holds modulo 5. It also holds when we 
apply T, so it holds in G. 

We have constructed an endomorphism of G fixing S and inducing a, and this 
forces it to be an automorphism. □ 

Let Auto(G) C Aut(G) be the finite index subgroup consisting of automor- 
phisms fixing 5 and mapping into Auto(-ff). We know that the map (p : Auto((j) 
Auto(iy) is onto and has a section. We consider its kernel. 

Lemma 4.2. The kernel N of (f : Auto(G) — > Auto(iy) is isomorphic to T}' . It 
is generated by twists by S around the edges o/F \ Fq. 

Recall that b is the first Betti number of F. 

Remark. It is a general fact that, whenever Z C G is characteristic, the kernel 
of the map Aut(G') Aut(Z) x Aut(G'/Z) is abelian [29, Proposition 2.5]. To 
see this, take q;i,q;2 in the kernel. Write ai{g) = zig and 0:2 (5^) = gz2 (with 
zi,Z2 G Z, depending on g), and deduce aia2{g) = oc20ci{g) = Z\gz2 (one can also 
prove that zi must be in the center of G) 
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Proof. Suppose a & N . We have a{5) = S. If x is a root of 5, we have a{x) = x5^ 
and 5 = x'^, so that d = a{x'^) = 55^'^ and p = 0. Therefore a fixes every eUiptic 
element. Furthermore ait^) — 5^^^ for some e Z, so a is a product of powers 
of twists by 5. Conversely, each choice of integers ng determines an automorphism 
fixing all elliptic elements and belonging to N. □ 

We have proved: 

Theorem 4.3. // G is nan- elementary and unimodular, there is a split exact 
sequence 

{1} ^ ^ AutoCG) ^ AutoiH) ^ {1}, 

where H is virtually free and Auto has finite index in Aut. □ 
We shall now show: 

Theorem 4.4. If G is non- elementary and unimodular, there is a split exact 
sequence 

(1} ^ ^ Outo(G) X Outo(if) ^ {1}, 
where H is virtually free and Outo has finite index in Out. 

See Proposition 3.3 for the definition and properties of k. 
Since Out(iy) is VF [19], this implies: 

Corollary 4.5. Out(G) and Aut(G) are virtually torsion-free and VF (they have 
finite index subgroups with finite classifying spaces). O 

Proof of Theorem 4-4 ■ We denote by Outo the image of Auto in Out (note that 
Auto does not contain all inner automorphisms if A 1), and by N the image of 
N in Out(G). Let if) : Outo(G) Outo (if) be the natural map. Note that N is 
contained in ker?/^, and has torsion-free rank k by Lemma 4.2 and Assertion (3) of 
Proposition 3.3. We shall show ker'i/^ — N ^ Z^. We write ig for conjugation by 
9- 

First assume A = 1. Then k = and iV ~ because it has torsion-free rank 
b and is a quotient of ~ Z^. Since the image of r is abelian, every conjugation 
ig in G satisfies r o ig = r, and Lemma 4.1 lifts ih € Auto(i?) to ig, where ig is 
any lift of h. Thus i/j has a section. 

There remains to show kerV' C N. If a e Auto(G) represents an element 
of keri/j, its image a in Auto (if) is conjugation by some h E H. Lift ih to 
ig e Auto(G), and consider i~^a. It belongs to N, and has the same image 
as a in Out(G). This implies kert/j = N. 

Now suppose A 7^ 1. In this case we have to choose d = (^o)^, where do is a 
generator of Z (the center of G~^). We first show that ker'^ = N. The argument 
is the same as before, but we have to prove that i^ has a lift ig G Auto(G) (we 
will see that Lemma 4.1 lifts inner automorphisms to inner automorphisms, but 
we cannot claim it at this point). Since r o a = r, the image r(/i) is central in 
F. Our choice of 6 ensures that the center of F has order 2 (it is generated by 
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the image of a; i— > a; + 1/2). In particular, h is positive. If e G is a lift of h, it 
commutes with 5 and therefore ig belongs to Auto(G). 

We now prove N ^ Z^~^. Recall that N has torsion-free rank 6—1. 

Consider the twist D by 6 — (5o)^ around the edges e of F \ Fq such that 
A{ts) = —1 (it fixes the generators x^,, and maps tg to if A(te) = 1, to Ste if 
A(te) = —1). Note that D is conjugation by (Sq)^. Indeed, the te's with modulus 1, 
and the x^'s, are fixed by D and commute with 5o, whereas (5o)^^e = ('^o)^^e(^o)~^ 
if teSt~^ = 6~^. Since D belongs to a basis of N (see Lemma 4.2), the image N 
of N in Out(G) is isomorphic to 

Finally, we show that Lemma 4.1 lifts inner automorphisms to inner automor- 
phisms (and therefore ip has a section). 

Suppose ifi belongs to Auto(i?). Then t(/i) is central in F, and therefore 
T{h?) is trivial. If (7 G G is a lift of , then r{g) is an integral translation and 
we can redefine g (multiplying it by a power of 5) so that T{g) is trivial. Then 
T{gug~^) — t{u) for every u E G, showing that Lemma 4.1 lifts conjugation by 

to conjugation by g in G. Now consider the lift a of ih given by Lemma 4.1. 
It satisfies = ig, and its image in Out(G) belongs to kerip. Since kerip = N is 
torsion-free, we conclude that a is inner. □ 

5. The deformation space 

Let G be a non-elementary GBS group. In this section, we work with metric 
GBS trees: T is a metric tree, and G acts by isometries. Metric trees are considered 
up to G-equivariant isometry. 

Let T> be the space of metric GBS trees, and PT> its projectivization (obtained 
by identifying two trees if they diflFer by rescaling the metric). We call PT> the 
(canonical) projectivized deformation space of G. 

Choosing a G-invariant metric on a given simplicial tree amounts to assigning a 
positive length to each edge of F = T/G. This makes PV into a complex. An open 
simplex is the set of trees with a given underlying simplicial tree, a closed simplex 
is the set of GBS trees that may be obtained from trees in an open simplex by 
collapse moves (closed simplices have "faces at infinity", as the length of a non- 
collapsible edge is not allowed to be 0). Every closed simplex contains reduced 
trees. 

The group Out(G) acts on PV. There is a bijection between the set of orbits 
of open simplices and the set of (unmarked) labelled graphs representing G (up 
to admissible sign changes). Standard techniques show that PV has a natural 
Out(G)-equivariant deformation retraction onto a simplicial complex (see [7, 24]). 

GBS trees are locally finite. This implies that the complex PV is locally finite. 
Indeed, closed simplices containing T consist of simplicial trees obtained from T 
by expansion moves. Performing such moves on T amounts to blowing up each 
vertex v oiT into a subtree. Since v has finite valence, there are only finitely many 
ways of expanding (not taking the metric into account). As remarked by M. Clay, 
this local finiteness gives another proof of the first assertion of Theorem 3.10. 
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In general, there are several ways to define a topology on spaces of trees (equi- 
variant Gromov-Hausdorff^ topology, axes topology, weak topology), but because 
of local finiteness they all coincide on PV (see the discussion in [15, 16]). Clay 
[3] proved that PV is contractible (see also [16]). By Theorem 3.10, stabilizers for 
the action of Out(G) on PT) are virtually Z'^. 

To sum up: 

Proposition 5.1. Out(G) acts on the locally finite, contractible, complex PV 
with stabilizers virtually Z'^. □ 

If G is algebraically rigid, the unique reduced GBS tree belongs to every closed 
simplex, PV is a finite complex, and the action of Out(G) on PV has a fixed point. 
If G is not algebraically rigid, we will show that Out^(G) always has infinite index 
in Out(G) (see Theorem 8.5). All Out(G)-orbits are therefore infinite. 

Under suitable hypotheses, we now show that PV is "small" and we deduce 
information on Out(G). 

Groups with no nontrivial integral modulus. 

Suppose that G has no integral modulus other than ±1 (equivalently, G does 
not contain a solvable Baumslag-Solitar group BS{1, n) with n > 1). In this case, 
there are only finitely many Out(G)-orbits of simplices consisting of reduced trees 
[12, Theorem 8.2], and therefore Out(G) acts on the complex PV with only finitely 
many orbits. This implies: 

Theorem 5.2. Let G be a non- elementary GBS group with no integral modulus 
other than ±1. 

(1) Out(G') is (it has a K{'k, 1) with finitely many cells in every dimen- 
sion). 

(2) There is a bound for the cohomological dimension of torsion-free subgroups 
of Out (G). 

(3) If Out(G) is virtually torsion-free, it has a finite index subgroup with a 
finite classifying space. 

(4) Out(G) contains only finitely many conjugacy classes of finite subgroups. 

Proof. The first three assertions follow from Proposition 5.1 by standard tech- 
niques. Unfortunately, we do not know whether Out(G) must be virtually torsion- 
free when G is not unimodular. Assertion (4) follows from Theorems 3.10 and 
3.11: any finite subgroup is contained in some Out-^(G), and it is well-known that 
there are finitely many conjugacy classes of finite subgroups in a group which is 
virtually Z'^ (a proof appears in [20]). □ 

Groups with no strict ascending loop. 

It is shown in [16] that, if no reduced labelled graph contains a strict ascending 
loop, there is an Out(G')-equivariant deformation retraction from PV onto a finite- 
dimensional subcomplex. This implies: 
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Theorem 5.3. // no reduced labelled graph representing G contains a strict as- 
cending loop, there is a bound for the cohomological dimension of torsion-free sub- 
groups of Out (G). □ 



6. Free subgroups in Out(G') 

Let r be a labelled graph. Recall that we consider it up to admissible sign 
changes. In particular, when we focus on an edge, we will always assume that 
it is a (p, (3')-segment with p, > 1 (> 2 if F is reduced), or a {p,q)-loop with 
1 < p < \q\. Recall that a strict ascending loop is a (l,q')-loop with \q\ > 2. A 
pseudo-ascending loop is a (p, g)-loop with p\q. 




Figure 7. Slide move. 

If e, / are distinct oriented edges with the same origin v, and the label A/ of / 
at V divides the label Ae of e, one may slide e across /, replacing its label by y^Aj 

(see Figure 7); both e and / may be loops, but they have to be distinct geometric 
edges (/ 7^ e). See [12] for details about slide moves. The important thing for 
us here is that performing a slide move on a labelled graph gives another labelled 
graph representing the same group G (only the GBS tree changes). 

An edge / is a slid edge if some other edge may slide across f or f (we usually 
think of slid edges as non-oriented edges). For example, any (l,(j)-loop is a slid 
edge if F contains more than one edge (i.e. if G is not solvable). 

The goal of this section is to prove the following result (see Figure 8, where the 
numbers within parentheses refer to the assertions of the theorem): 

Theorem 6.1. Let F be a reduced labelled graph representing G. Suppose Out(G') 
does not contain F2. Then: 

(1) A slid edge is either a (2, 2)-segment or a (1, q)-loop. 

(2) Slid edges are disjoint. 

(3) A pseudo-ascending loop is a (p, ±p)-loop or a (1, q)-loop. 

(4) If V is the basepoint of a {l,q)-loop with \q\ > 2, then no other label at v 
divides a power of q. 

(5) If V is the basepoint of a (1, q)-loop with \q\ > 2, and r, s are two labels at 
V not carried by the loop, then s does not divide any rq^ . 

(6) Let vw be a (2, 2)-segment. Let r be a label at v, and s a label at w (other 
than those carried by vw). If r\s and s is even, then r = s and the labels 
are carried by the same non-oriented edge. 
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(3) (4) (5) (6) 



Figure 8. If F contains one of these graphs, Out(G') contains F2. 

We prove Theorem 6.1 in several steps. Our two main tools will be slide moves 
and Lemma 3.2. 

Slid segments are (2, 2)-segments. 

Let / be a slid (p, (3')-segment with p,q > 2. Consider the graph of groups 
obtained by collapsing /. It has a vertex group isomorphic to (a, b \ = b'^). 
Let e be an edge of F that may slide across /, viewed as an edge of G. Its group 
Ge is generated by a power of a^, so is central in Hy. By Lemma 3.2, the group 
r(e) C Out(G') maps onto J = ZnSGe) / {Z{Hy), Z{G^)) = {a,b \ aP ^ b^ ^ 1). 
If (p, q) 7^ (2, 2), the group J contains F2, so Out(G') contains F2. 

Remark 6.2. For future reference, note that T(0) contains T(F) by Remark 3.1, 
and furthermore the image of T(F) in J is finite. To see this, recall that T(F) 
is generated by the groups Zq^^^,^{G fi) with f ^ f,J (Remark 3.1). All these 
groups have trivial image in J, except (Gg) whose image is finite. 
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Slid loops are (l,g)-loops. 

We assume that e slides across a {p,q)-loop f with 2 < p < \q\, and we show 
that Out(G) contains F2. If IqI > 3, we create a slid (p, (j)-segment by performing 
an expansion move (replacing the loop by a {p, g)-segment and a (1, l)-segnient), 
and we apply the previous argument (which is valid even if the labelled graph is 
not reduced). If / is a (2, ±2)-loop, we collapse it and we apply Lemma 3.2. We 
now have Hy = (a,t | ta'^t~^ = a^^), and is generated by a power of a^. The 
quotient Zn^iGe)/ {Z{Hy), Z{Ge)) is isomorphic to Z * Z/2Z, so contains F2. 

Pseudo-ascending loops are (p, ±p)-loops or (1, g)-loops. 

This amounts to showing that F cannot contain an (r, rs)-loop with r > 2 and 
\s\ > 2. If it does, write G ^ d G2, with Gi = (a,t | ta'^f-^ = a'^^). By [6], 
there exist two automorphisms of Gi fixing a and generating a free subgroup of 
rank 2 in Out(Gi) (in the notation of [6], set = </?o = t = 1 to see that the 
subgroup of Out(Gi) generated by a and 72 maps onto Z/rZ*Z/s^Z). Extend the 
automorphisms by the identity on G2 and check that they generate F2 C Out(G). 

Here is another argument, valid when r or \s\ is bigger than 2: perform an 
expansion and a slide to obtain a graph with a slid (r, s)-segment. 

Slid edges are disjoint. 

We argue by way of contradiction. There are several cases to consider (they 
are pictured from right to left on Figure 8) . First suppose that v belongs to a slid 
(2, 2) -segment / and a (l,g)-loop /'. If q is even, one may slide /' across / and 
then collapse /'. This creates a (2, 2g)-loop, a contradiction. If q is odd, some 
other edge may slide across /. Sliding / around /' makes / a slid (2, 2(j)-segment, 
a contradiction if Ig] > 1. If g = ±1, collapse both / and /' and apply Lemma 3.2. 

Now suppose V belongs to a (l,q')-loop / and a (l,r)-loop /'. If \q\ > 2, 
sliding /' around / makes it a (g, r)-loop, and then sliding /' twice makes it a 
(g, g^r)-loop. If |g| = |r| = 1, we may write G as an amalgam Gi *(^a) G2, with 
G2 = {a,t,t' I taf-^ = a^^,t'at'-^ = a^^). It is easy to embed F2 into Out(G) by 
using automorphisms of G2 fixing a. 

Finally, suppose that (2, 2)-segments / and /' have a vertex v in common. We 
may assume that their other endpoints are distinct, as otherwise sliding / across 
/' would create a slid (2, ±2)-loop. 

The fundamental group of the subgraph of groups / U /' is J = (a, 6, c | = 

= c^). Consider the following automorphisms a,/? of J: a fixes a and h and 
conjugates c by 6a, while /? fixes 6, c and conjugates a by he. They extend to 
automorphisms of G (they are twists in the graph of groups obtained from F by 
collapsing /' and / respectively). We claim that generate a free nonabelian 
subgroup of Out(J) (hence also of Out(G) because J is its own normalizer). 

Indeed, consider J ~ 7a/27i*7i/27i*7i/27i obtained by adding the relation o?' — 1. 
Let J""" C J be the subgroup of index 2 consisting of elements of even length. It is 
free with basis {ah,hc}. With respect to this basis, a acts on the abelianization of 



J'^ as the matrix 
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as ±Id. It follows that there is no nontrivial relation between a and /3 in Out(J). 

Labels near a (l,(j)-loop. 

Let V be the basepoint of a {l,q)-\oop. We already know that no other label 
r at f equals 1 or divides q (it would be carried by a slid edge). Suppose that 
r divides some g". Let £ be a prime divisor of r. Expand v so as to create a 
(1, £)-segment, and collapse the (1, |)-edge (see Figure 9). The new labelled graph 
is isomorphic to F, except that r has been divided by i and other indices at v have 
been multiplied by |. Repeat this operation until r divides q, a case already ruled 
out. 




Figure 9. Replacing r by r/£. 

Now let r, s be labels at v carried by edges e, /, with s\rq'^. If f e, we can 
make e a slid edge by sliding it n times across the loop. If / = e, we can create 
an (s, rq'"^"'"^)-loop, contradicting (3). 

Labels near a (2, 2)-segment. 

Let vw be a (2, 2)-segment. We already know that all other labels at v and w 
are bigger than 2 in absolute value. Furthermore, if r, s are labels at the same 
vertex {v or w), and r\s, then r = ±s and they are carried by a loop. Assertion 
(5) of the theorem follows: since s is even, one can perform a slide across vw so 
that s becomes a label at v. 

7. Groups with Out(G') :^ F2 

In this section, we complete the proof of Theorem 1.6 by showing: 

Theorem 7.1. // a non- elementary GBS group G is represented by a reduced 
labelled graph F satisfying the conclusions of Theorem 6.1, then Out(G) is virtually 
nilpotent of class at most 2. 

The theorem is true if G is a solvable Baumslag-Solitar group [5], so we rule 
out this case. As we wish to study the whole automorphism group of G, it is 
important in this proof to think of F as a marked graph. As usual, we denote by 
T its Bass-Serre tree. 

In general, there are many graphs representing G, and the first step in the 
proof of Theorem 7.1 will be to show that collapsing the slid edges of F yields a 
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marked graph of groups G and a (non GBS) tree 5' which are canonical (they do 
not depend on F). In the language of [10], we first show that all possible trees 
S belong to the same deformation space, and then using [21] that there is only 
one reduced tree in that space. In particular Out(G) = Out'^(G), and we shall 
conclude the proof of Theorem 7.1 by showing that Out'^(G) is virtually nilpotent. 

We know that the slid edges of F are disjoint, and are either (2, 2)-segments or 
(1, q')-loops. Define and S by collapsing them. 

Consider edge and vertex groups of 0. Edge groups are cyclic. Non-cyclic 
vertex groups are Klein bottle groups (a, b \ a'^ — b'^) arising from collapsed (2, 2)- 
segments, and solvable Baumslag-Solitar groups BS{l,q) = {a,t \ tat~^ = a^) 
arising from collapsed (1, q')-loops. Note two special cases: if = 1, a Klein 
bottle group if g = — 1. 

It is useful to think of BS{1^ q), for |g| > 2, as the subgroup of the affine group 
of R generated by a : x ^ x + 1 and t : x ^ qx. It consists of all maps of the form 
X I— > q'^x + (3 with CK e Z and (3 e Z[|^]. One deduces, for instance, that powers 

a*, are conjugate if and only if ^ is a power of q. The element has an s-root 
if and only if s divides some rg"; the root is then unique. 

Lemma 7.2. The set of vertex stabilizers of S does not depend on the marked 
graph V. In particular, it is OvLt{G) -invariant. 

Proof. By Corollary 2.2, it suffices to show that the vertex stabilizers of S are 
determined by the elliptic subgroups of T. This will be done using the tree T, but 
the description of vertex stabilizers will involve only the algebraic structure of the 
set of elliptic subgroups. 

Let f be a vertex of T, and v its projection in F. We denote by tt : T — > 5 the 
collapse map. We want to understand the stabilizer Hy of 7r{v) in S. It is also the 
stabilizer of the subtree 7r~^(7r(f)) C T. 

If no strict ascending loop is attached at U, the stabilizer Gy of is a maximal 
elliptic subgroup of T. Conversely every maximal elliptic subgroup arises in this 
way. If a (l,g)-loop with \q\ > 2 is attached at v, there is no maximal elliptic 
subgroup containing Gy; if T' is another GBS tree, then Gy is not necessarily a 
vertex stabilizer of T' (see [12]). 

We first determine the group Hy containing a maximal elliptic subgroup Gy. 

Consider the normalizer N{Gy). If it is or a Klein bottle group, then v 
bounds a (l,±l)-loop and Hy — N{Gy). Otherwise, N{Gy) — Gy. Let a be a 
generator of Gy. Then Hy is the centralizer Z(a^) if v bounds a slid (2, 2)-edge, 
Gy if not. 

To decide which (in terms of Gy only), first observe that v bounds a (2, 2)-edge 
(slid or not) if and only if Zla^) is a Klein bottle group. Assuming it is, consider 
(as in [16]) the set of groups of the form Z{a'^) HK, where K is an elliptic subgroup 
of T not contained in Z(o^). It is easy to see that the edge is slid if and only if 
some maximal element of this set (ordered by inclusion) is contained in (a^). 

Now suppose that a (1, g)-loop with \q\ > 2 is attached at v. Then Hy = {a,t \ 
tat~^ — a'^), where a is a generator of Gy. 
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Condition (4) of Theorem 6.1 implies that 7r(?;) is the only point of S fixed by 

ifi divides a power of q: stabihzers of edges adjacent to n{v) in S are conjugate 
in to (a^), where r does not divide any g"; since is not conjugate (in H^) 
to a power of such an a'^, it cannot fix an edge. 

As in [12] , say that an eUiptic subgroup K of T is vertical if any eUiptic subgroup 
K' containing K is contained in a conjugate of K. For the action of on T, the 
subgroup (a^) is vertical if and only if i divides a power of q. We show that the 
same result holds for the action of G on T. 

Suppose that £ divides a power of q. If K' D (a^) is elliptic (in T, hence 
also in S), then 7r{v) is the only point of S fixed by K', so K' fixes a point 
w e ti~^{tt{v)) C T. The stabilizer of w is conjugate to (a) in Hy^ and (a) is 
contained in a conjugate of (a^) because £ is a power of q. Thus K' is contained in 
a conjugate of (a^), and (a^) is vertical as required. Conversely, if (a^) is vertical, 
then it contains a conjugate g{a)g^^ with g & G. Since 7r{v) is the only point of 
S fixed by a, we have g e Hy and we deduce that £ divides a power of q. 

We now conclude the proof, by characterizing the vertex stabilizer of S 
containing a vertical subgroup K G G which is not maximal elliptic. We know 
that K is generated by a^, where a generates a vertex stabilizer Gy^ a (1, g)-loop 
with |g| > 2 is attached to v, and £ divides a power of q. In particular, K fixes a 
unique point 7r{v) e S. 

The stabilizer Hy of 7t{v) is isomorphic to BS{1, q). The set of elements of Hy 
which are elliptic in T is an abelian subgroup (isomorphic to Z[ji|-]), so gKg~^ 

commutes with K if g & Hy. Conversely, if gKg~^ commutes with K, then 
g G Hy because Ti{y) is the only fixed point of K in S. We may now characterize 
Hy (independently of T) as the set of g e G such that gKg~^ commutes with K. 

n 

Lemma 7.3. The G-tree S does not depend on T. In particular, Out'^(G) = 
Out(G'). 

Proof. We apply the main result of [21] . Since S is reduced (no inclusion Ge ^ Hy 
is onto), it suffices to check that the following holds. Let e and / be oriented edges 
of S with the same origin such that Gf C Ge] if e, / do not belong to the same 
G-orbit, then e, / are in the same orbit and Ge = Gf. 

Let V, w be the origins of e and / in T. Let cq, fo be the projections in F, and 
r, s the corresponding labels. We distinguish several cases. 

First assume v = w in T. If no collapsing takes place at v, or if v bounds a 
(1, ±l)-loop, then Gf C Ge implies that r divides s. This is possible only if cq 
and fo are opposite edges forming a (p, ±p)-loop. 

Now suppose that v bounds a (1, g)-loop with |g| > 2. Write the corresponding 
vertex stabilizer Hy of S as {a,t \ tat~^ — a'^). Then (a^) is conjugate in Hy to a 
subgroup of (a*"), so there exists n such that is a power of q. This contradicts 
Assertion (5) of Theorem 6.1, so this case cannot occur. 

Finally, suppose that vw is a slid (2, 2)-edge. The stabilizer of 7r(z;) in 5" is 
then Hy = (a, 6 | = 6^). The subgroups Ge and Gf of Hy are generated by 
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conjugates of powers of a or b. Distinct powers of a (resp. b) are not conjugate in 
Hy, while a* is conjugate to b^ only when i and j are equal and even. In particular, 
r divides s. If cq and /o have the same origin (v or w), we conclude as in the first 
case. If not, then s must be even and we use Assertion (6) of Theorem 6.1. □ 

We may now study Out(G) = Out'^(G) using the results of [20] recalled in 
Section 3. In particular, p has a restriction pi : Outf (G) Yiuew 0\xt{Hu) with 
Outf (G) of finite index in Out(G) and ker pi = T{S) (we denote by W the vertex 
set of G, and by the vertex group of w G W). 

We first show that T{S) is virtually abelian. It is generated by centralizers of 
edge groups in vertex groups Hu- If is Z or Z^, the centralizer is of course Hu- 
If = BS{l,q) with |g| > 2, the centralizer is an infinitely generated abelian 
group isomorphic to If is a Klein bottle group, the centralizer is Z^ if 

u comes from a (1, — l)-loop, Z if w comes from a slid (2, 2)-segment and the edge 
group is not central, the whole of Hu if the edge group is central. Since a Klein 
bottle group is virtually abelian, so is T{S). 

Remark 7.4. Relations in the presentation of T{S) come from centers of edge 
and vertex groups of ©. Since these centers are {1}, Z, or Z^, the group T{S) is 
finitely generated if and only if T contains no strict ascending loop. 

Now fix a vertex u of ©, and define Pu C Out{Hy,) by projecting the image of 
pi. If Hu is Z or a Klein bottle group, Pu is finite because Out{Hu) is finite. We 
claim that P^ is finite also when Hu is BS{1, q) with \q\ > 2. 

Write Hu — {a,t \ tat~^ = a'^). The vertex u is obtained by collapsing a (1, g)- 
loop fu of r. Denote its basepoint by v. Since G is assumed not to be solvable, we 
may consider an edge group (a'~), where r is a label near v not carried by fu- Its 
image by an automorphism a & Pu is also an edge group, so a{{a'^)) is conjugate 
to (a*) for some label s (possibly equal to r). But a'' has an s-th root only if s 
divides some rg"^, so r = s by Assertion (5) of Theorem 6.1. By uniqueness of 
roots, a maps a to a conjugate of a^^. Only finitely many outer automorphisms 
of Hu have this property [5], so Pu is indeed finite. 

The group Pu is infinite only when u comes from collapsing a (1, l)-loop fu- In 
this case, Hu = {a,t \ tat~^ = a). As above, a must be mapped to a conjugate of 
a^^, so Pu contains with index at most 2 the group generated by the automorphism 
Df^ fixing a and mapping t to at- We view Df^ as an automorphism of G (extend 
it by the identity). It is a twist relative to F, but not to G (Remark 3.1 does not 
apply here, as is not a segment; in general, none of the groups T{S), T{T) 
contains the other). 

This analysis shows that T{S) and the automorphisms Df^ associated to (1, 1)- 
loops of r generate a finite index subgroup of Out(G). We replace T{S) by an 
abelian subgroup ^(<S') of finite index, and we complete the proof of Theorem 7.1 
by showing that the subgroup generated by To{S) and the automorphisms Df^ is 
virtually nilpotent of class < 2: every commutator is central. 

Non-commutativity only comes from the fact that Df^ may fail to commute 
with D{z), when z e Hu and D{z) is a twist of G around an edge e with origin u. 
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Write Hu = (a,t | tat''^ = a). The group Ge is generated by a power of a. 

Recall that D/„ fixes a and maps t to at. In particular, D{z) commutes with 
Df^ if 2; is a power of a (both automorphisms belong to T(T)). The interesting case 
is when z = t (geometrically, u carries a 2-torus T^, e carries an annulus attached 
to a meridian of T^, is a Dehn twist in around a meridian, and D{t) drags 
the annulus around along the longitude). But conjugating D{t) by Df^ gives 
D{ta), so the commutator of D(t) and Df^ is D{a), a central element. This easily 
implies that every commutator is central, completing the proof of Theorem 7.1. 

8. Further results 

Nilpotent vs abelian. 

Corollary 8.1. If G is represented by a reduced labelled graph with no (1, l)-loop, 
then Out(G) contains F2 or is virtually abelian. 

This follows immediately from the proof of Theorem 7.1. More generally, if 
Out((j) does not contain F2, it is virtually abelian if and only if every commutator 
D{a) as in the last paragraph of the proof has finite order. This happens in 
particular when the basepoint of every (1, l)-loop has valence 3. See Remark 3.4 
for a more complete discussion. 

Finite generation. 

Here is a general fact: 

Proposition 8.2. Let V be a labelled graph representing a GBS group G. If T 
contains a strict ascending loop, but G is not a solvable Baumslag-Solitar group, 
then Out(G) has an infinitely generated abelian subgroup. 

Proof. Collapse the loop and apply Lemma 3.2 to an edge e with origin at the 
collapsed vertex v (there is such an edge because G is not solvable). We have 
iy„ = BS{l,q) with \q\ > 2, and Zfj^iGe) is infinitely generated abelian (it is 
isomorphic to Z[j^]). The center of Hy is trivial, and the center of Ge is cyclic. 

The subgroup of T(G) generated by Zu^iGe) is isomorphic to or is an 

infinite abelian torsion group. □ 

From the proof of Theorem 7.1 we get: 

Corollary 8.3. Let V he a reduced labelled graph representing a non-solvable GBS 
group G with Out(G) virtually nilpotent. The group Out(G') is finitely generated 
if and only if T contains no strict ascending loop. 

Proof. We have seen that Out(G) is generated by the union of T(S) and a finite 
set, so by virtual nilpotence Out(G) is finitely generated if and only if T{S) is 
finitely generated. The corollary now follows from Remark 7.4. □ 

Corollary 8.4. If no label ofV equals 1, then Out(G) contains F2 or is finitely 
generated and virtually abelian. O 

In the virtually abelian case, the torsion-free rank may be computed from k 
and the labels near the (2, 2)-edges. 
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Algebraic rigidity. 



Theorem 8.5. If the GBS group G is not a solvable Baumslag-Solitar group, the 
following are equivalent: 

(1) G is algebraically rigid (there is only one reduced GBS tree). 

(2) The deformation space PV is a finite complex. 

(3) Out(G') is virtually TJ^ (with k defined in Proposition 3.3). 

(4) Let r be any reduced labelled graph representing G. If e, / are distinct 
oriented edges of V with the same origin v, and the label of f divides that 
of e, then either e = f is a (p, ±p)-loop with p>2, or v has valence 3 and 
bounds a (l,±l)-loop. 

Remarks. • If G is unimodular, (3) (4) follows from Theorem 4.4 and [27, 
Corollary 5.14]. 

• Suppose \n\ > 2. Then BS{l,n) is algebraically rigid if and only if \n\ is 
prime [21], while OvLt{BS{l,n)) is virtually (i.e. finite) if and only if |n| is a 
prime power [5]. 

Proof. The equivalence (1) (4) is in [21], and (1) =^ (2) =^ (3) follows from 
Sections 3 and 5. We prove (3) =^ (4). 

Suppose that Out(G) is virtually Z'^ (equivalently, T(r) has finite index in 
Out(G)). Let e, / be adjacent edges with A/|Ae. By Theorem 6.1 and Proposition 
8.2, the edge / must be a slid (2, 2)-segment or a (p, ±p)-loop. 

It cannot be a segment because of Remark 6.2: after collapsing /, the group 
T(©) C Out(G) would map onto the infinite dihedral group J — {a,b \ — b'^ = 
1) with the image of T{T) finite, a contradiction. To prove (4), there remains to 
show that the basepoint of any (l,±l)-loop has valence 3. 

Let / be a (1, £)-loop, with e — ±1, let v be its basepoint, let ei, . . . , e„ be the 
oriented edges with origin v (other than /, /). We must show n = 1. 

First consider the subgroup Tq of T = T(r) generated by the twists D^^ and 
the twists around edges with origin other than v. The group T is generated by Tq 
and the twists D/, D^. The only relations involving Df,Dj are -D/ + £-0/ = 
(edge relation) and D f -\- D j -\- -Dg . = (vertex relation). It follows that Tq 
has index at most 2 in T if e = — 1, that T is the direct sum of Tq and the infinite 
cyclic group generated hj Dj if e = 1. 

Now let O be the graph of groups obtained by collapsing /, and consider T' = 
T(0). We will see that it is generated by % together with extra twists around 
the edges e,; (note that edge group centralizers are bigger in © than in F). To 
describe D'- precisely, we distinguish two cases. 

If £ = —1, the vertex group of f in is a Klein bottle group (a, t \ tat~^ = 
a~^). Its center is (t^). The edge groups Ge^ are generated by powers of a. Their 
centralizer in Hy is the free abelian group generated by a and t^. In this case, D[ 
is the twist by around e^. The only relation involving D'- is the vertex relation 
J2i D[ = 0, so T' is the direct sum of Tq and Z"'~^. As Tq has index at most 2 in 
T, we must have n — 1 since T has finite index in Out(G). 
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If £ = 1, we still have T' = Tq® Z"'"-^ (the vertex group Hy is 7? = (a, t), and 
D'- is the twist by t). There is a natural homomorphism from (T, T') to Out(-ff„), 
given by the action on H^j. The kernel contains T', but its intersection with T is 
Tq (as -D/ acts on by fixing a and mapping t to at). Since T has finite index 
in Out(G), hence in (T, T'), we deduce that 7^ = T fl T' has finite index in T', 
so n = 1. n 

Combining with Proposition 3.3, we obtain: 

Corollary 8.6. Let T be a reduced labelled graph representing a group G. The 
group Out(G) is finite if and only if one of the following holds: 

(1) V is a tree with no divisibility relation; 

(2) V is a graph with first Betti number 1, there is no divisibility relation, and 
G has nontrivial modulus; 

(3) r is obtained from, a tree with no divisibility relation by attaching one 
{k, —k)-loop. If k > 2, no other index at the attaching point is a multiple 
or a divisor of k. If k = 1, the loop is attached at a terminal vertex. □ 

On the isomorphism problem. 

Given a labelled graph F, it is easy to decide algorithmically whether the asso- 
ciated GBS group G is elementary, solvable, unimodular. By Theorems 6.1 and 
7.1, we may decide whether Out(G) contains F2 or is virtually nilpotent. 

The isomorphism problem for GBS groups is the problem of deciding whether 
two (reduced) labelled graphs represent isomorphic groups or not. It is solved for 
rigid groups (obviously), for groups with no nontrivial integral modulus [12], and 
for 2-generated groups [22]. 

Theorem 8.7. The isomorphism problem is solvable for GBS groups such that 
Out(G) does not contain a non-abelian free group. 

Proof. Let F be a reduced labelled graph representing G. We assume that Out(G) 
does not contain F2, so F satisfies all six conditions of Theorem 6.1. 

We describe three ways of producing new labelled graphs representing G (be- 
sides admissible sign changes). The first one changes the graph, the other two only 
change the labels. 

(1) Sliding an edge across a (2, 2)-segment: it changes the attaching point of 
an edge (carrying an even label). 

(2) If V is the basepoint of a (1, q')-loop, one may multiply or divide by q some 
other label near v, by sliding the corresponding edge around the loop. 

(3) If V is the basepoint of a (1, g)-loop, one may multiply or divide all other 
labels near v by any number p dividing q, by performing an expansion at 
V followed by a collapse (see Figure 10; this is called an induction move in 
[21]). 

Consider the set Q consisting of all labelled graphs which may be obtained from 
F by combining these moves. They are reduced by condition (4) of Theorem 6.1, 
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Figure 10. Induction move. 

and it is easy to decide whether a given labelled graph V belongs to Q. We now 
complete the proof by showing that Q contains all reduced graphs representing G. 

As above, consider the graph of groups and the Bass-Serre tree S obtained 
by collapsing the slid edges of F. We have seen that S does not depend on the 
graph F used to construct it (Lemma 7.3). It thus suffices to show that the various 
ways of blowing up S into a GBS-tree differ by the moves mentioned above. 

First consider a vertex group Hy obtained by collapsing a (2, 2)-edge. It is a 
Klein bottle group (a, 6 | = b'^). The generator of any adjacent edge group is 
conjugate to some a* or V . Distinct powers of a (resp. b) are not conjugate in H^, 
while a* is conjugate to h' only when i and j are equal and even. It follows that 
all ways of blowing up v differ by slides across the (2, 2)-edge. 

Now consider a vertex group Hy = (a, t | tat~^ = a^) obtained by collapsing a 
(l,g)-loop of F. Let T' be another GBS-tree, associated to a labelled graph F'. 
As in the proof of Lemma 7.2, we cannot say that a generates a vertex group of 
T', only that some a*, with i dividing a power of q, does. 

Suppose for a moment i = 1. The generator of any edge group adjacent to v is 
conjugate to a power of a. As a"^, a" are conjugate in Hy only if ^ is a power of 
g, the labelled graphs F, F' differ by moves of type (2) near the (1, q)-\oop. 

If z 7^ 1, it is a product of divisors of g, and F, F' differ by moves of type (2) 
and (3). □ 

Remark. The same technique may be used when G is represented by a graph 
F satisfying the six conditions of Theorem 6.1, but with arbitrary slid segments 
allowed in condition (1) (not only (2, 2)-segments). Condition (6) must then be 
rephrased as follows: Let vw be a (p, q)-edge. Let r be a label at f , and s a 
label at w. If q\s and qr\sp, then qr = sp and the labels are carried by the same 
non-oriented edge. 
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